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PARAMETER IDENTIFICATION USING A 


CREEPING -RANDOM -SEARCH ALGORITHM 

By Russell V. Parrish 
Langley Research Center 

SUMMARY 

A creeping -random -search algorithm is applied to different types of problems in 
the field of parameter identification. The studies reported are intended to demonstrate 
that a random-search algorithm can be applied successfully to these various problems, 
which often cannot be handled by conventional deterministic methods, and, also, to intro- 
duce methods that speed convergence to an extremal of the problem under investigation. 
Six two-parameter identification problems with analytic solutions are solved, and two 
application problems are discussed in some detail. 

Results of the study show that a modified version of the basic creeping -random - 
search algorithm chosen does speed convergence in comparison with the unmodified ver- 
sion. The results also show that the algorithm can successfully solve problems that con- 
ain limits on state or control variables, inequality constraints (both independent and 
.ependent, and linear and nonlinear), or stochastic models. 

INTRODUCTION 

The field of parameter identification, that is, the problem of selecting optimal 
f alues for parameters in a mathematical model representing some physical system, is 
rapidly expanding into all areas of design work, as well as into a variety of other engi- 
neering contexts. Examples of the problem arise in two -point boundary value problems, 
control -system design problems, dynamic -model synthesis, and network-design problems. 
The importance of parameter optimization in the engineering design process has been 
pointed out in reference 1. 

In surveying the literature available in the field of parameter identification, two 
terms are encountered which seem to be used interchangeably: parameter optimization 
(refs. 1 to 4) and parameter estimation (refs. 5 and 6). A distinction is made between 
these two terms in the present paper, as follows: 

Parameter optimization is concerned with determining the parameter values of a 
model that define an extremum of some cost function (also referred to as a performance 



index or objective function) which is a function of model response. Problems in the area 
of mathematical programing and optimal control generally fall into this category. Param - 
eter estimation is concerned with determining the parameter values of a model in such a 
way that the model response matches the response of an actual physical system or desired 
reference system. In parameter estimation, the cost function is usually a function of the 
difference between the model response and some previously obtained test data from the 
physical system. Problems in this category can generally be subdivided into two classes. 
The first is one in which the parameters have physical meaning, such as the determina- 
tion of aerodynamic derivatives from flight -test data; and the second is one in which the 
parameters may have no meaning in the real world, such as curve fitting. 

In any event, the procedure usually adopted to solve problems in either subclass is 
iterative in nature, involving perturbation of the parameters, evaluation of the cost func- 
tion, a new perturbation of the parameters based on information gained from past pertur- 
bations, and so forth. Many deterministic algorithms exist in which these iterative 
methods are utilized; namely, steepest descent (ref. 7), conjugate gradient (ref. 8), 
Newton-Raphson (ref. 5), quasilinearization (ref. 6), Kalman filter (ref. 9), and simplex 
technique (ref. 10). These methods, as opposed to the random methods, generally con- 
verge well for favorable cost functions. However, as pointed out in references 4 and 11, 
if the cost function contains large higher -order derivatives with respect to the parameters, 
information gained from past perturbations will be of small value in determining future 
perturbations. 

Perhaps more significant is the fact that deterministic methods often fail com- 
pletely when physical limits are present on the control variables in the mathematical 
model (i.e., limits on commanded rates from an autopilot) and, also, when inequality con- 
straints are imposed on the state variables and/or the parameters of the system. 

Random methods, on the other hand, can be applied to problems containing any of 
the above restrictions. In reference 4, sequential random perturbation, or creeping ran- 
dom search, is suggested as a likely candidate for a successful algorithm that can be 
applied to many different classes of problems. However, the creeping -random -search 
algorithm is a brute -force method, in which many solutions of the mathematical model 
are required; as such, this algorithm is limited in its application by the number of param- 
eters to be selected and the amount of time necessary to solve the mathematical model. 

This report will introduce a modified version of the creeping -random -search algo- 
rithm that reduces the possible number of cost -function evaluations and still has the 
advantage of being applicable to many different types of problems (in particular, to those 
problems containing limits or inequality constraints). In addition, some of the various 
strategies available within the algorithm for speeding convergence to an extre num are 
evaluated and shown to be highly problem dependent in regard to successful s /plication. 
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I 

Another method for speeding convergence, which utilizes the interactive features pro- 
vided by a computer facility, is introduced and demonstrated. The algorithm was devel- 
oped for use on the NASA Langley Research Center’s CDC 6600 real-time digital simula- 
tion subsystem described in reference 12, in both an all-digital mode of operation and a 
hybrid mode of operation, in conjunction with a GPS 10 000 iterative analog computer. 

SYMBOLS 

A z stored flight data (normal acceleration) 

a z normal acceleration of attacking' aircraft 

aj,b^,bj,c } k arbitrary constants 
Fj arbitrary functional 

Fp penalty function 

g gravitational constant 

J(a^,Q! 2 ) scalar cost function dependent upon parameter values 
constant 

number of parameters (see table 1} 
probability (see table I) 
roll rate of attacking aircraft 
relative displacement between two aircraft 
number of tries (see table I) 

Laplace operator 
time 

out -of -plane displacement 
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Vt 

V 

v in 

v out 

X A 

*A 

X T 

Xrjn 

y A 

y A 

y T 

y T 

z 

du ( v in) 

dv 

dz ( v out) 

dv 


velocity of attacking aircraft 
velocity of target aircraft 
horizontal displacement 

horizontal displacement at entrance of magnetic field 

horizontal displacement at exit of magnetic field 

range of attacking aircraft 

range rate of attacking aircraft 

range of target aircraft 

range rate of target aircraft 

lateral displacement of attacking aircraft 

lateral velocity of attacking aircraft 

lateral displacement of target aircraft 

lateral velocity of target aircraft 

vertical displacement 

out -of -plane slope at V| n 

vertical slope at v Qut 
unknown parameter 
aileron -deflection command 
limited aileron -deflection command 
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X line -of -sight angle from horizontal 

l ,m , i,m dummy variables 

roll angle of attacking aircraft 
roll rate of attacking aircraft 
roll-angle command of attacking aircraft 
yaw angle of attacking aircraft 
yaw rate of attacking aircraft 
yaw -angle command of attacking aircraft 
yaw -rate command of attacking aircraft 
limited yaw -rate command of attacking aircraft 
yaw angle of target aircraft 

ANALYSIS OF CREEPING -RANDOM -SEARCH ALGORITHM 

The basic algorithm is illustrat ed with the two -parameter contour plot shown 
in figure 1. This basic algorithm, devoid of any strategies, operates in the follow- 
ing manner: In this simple problem, where the cost function to be minimized is 
J(ai,a 2 ) = a i + a 2 > constant values of the cost function are represented as concentric 
circles in the two-parameter plane. From an arbitrary starting point, a random step is 
taken and the cost function is evaluated. If the step has improved the cost function (a 
success), the present parameter values are used as a new starting point and a new step 
is taken. If the cost function was not improved (a failure), the original parameter values 
are retained and a new step is taken. Thus, a walk over the contour is generated. 

In conjunction with the basic algorithm, four strategies (to be explained in more 
detail later) were used: 

(1) Last successful direction first; after each success, the next step is taken 

in the same direction 

(2) Variable step size based on runs; the step size is increased after several 

successes in a row or decreased after several successive failures 


^A 

^A 

^c,A 

^A 

^A 
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(3) Correlation on past history; future steps favor the general direction in which 

past improvements were obtained 

(4) Correlation on last success; future steps favor the general direction in which 

the last improvement was obtained 



a 2 


Figure 1.- Two -parameter contour plot of basic algorithm. 

In explaining the basic algorithm in more detail, attention is directed to figure 2. 
As illustrated in figure 2, there are nine possible directions that can be taken from a 
given starting point in the two -parameter plane. These nine directions are obtained by 
plus, minus, and zero perturbations of each parameter, (Note that one direction is no 
movement at all.) The eight directions that involve movement are stored in an array 


Sign 

Designation 

¥ 

2 

0 

I 

- 

0 



Figure 2,- Details of basic algorithm. 
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which the algorithm samples randomly (ref. 13) without replacement until a success is 
obtained or all directions are exhausted, at which point the array is reinitialized. The 
storage designations for the directions are shown in figure 2. Note that the designations 
for opposite directions sum to 22. This fact was used to eliminate one direction from 
consideration whenever a success occurred; namely, the direction opposite to that which 
obtained the success (which is automatically a failure). Naturally, this direction is 
returned to consideration when the table is reinitialized. 

If failures should occur in all possible directions from a given point, the algorithm 
has either converged to an extremum, overstepped an extremum, or overstepped a pass 
(a pass is analogous to a ridge in a maximization problem). Figure 3(a) illustrates the 
case of overstepping an extremum; a reduction in step size would be necessary in order 
to continue convergence. Figure 3(b) demonstrates the case of overstepping a pass; and 
again a reduction in step size is necessary in order to continue convergence. 

Thus the event of failures in all possible directions from a given point requires a 
reduction in step size. This fact led directly to the comparison of two concepts of the 
basic algorithm; namely, a redundant algorithm (as proposed in ref. 4 for use on a highly 
specialized hybrid computer) and a nonredundant algorithm (the modified-creeping-search 
algorithm). In the redundant algorithm, no memory of past directions used from a given 
point is available; and, therefore, the same direction may be tried several times. The 
nonredundant algorithm has memory and never tries the same direction twice with the 
same step size. Table I shows a comparison of the number of tries necessary before a 
reduction in step size can be made between these two basic concepts (ref. 14). 

Again, a reduction in step size is necessary when overstepping has occurred or, 
equivalently, when failures are encountered in all possible directions. With the redundant 



(a) Extremum. 


Figure 3 . - Over st epping . 


(b) Pass. 
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algorithm, there can never be the certainty that all possible directions have been tried. 
Therefore, a 90 -percent confidence level on exhausting all of the directions has been 
set as the basis for comparison. 

Examination of table I reveals that the number of tries necessary for both algo- 
rithms increases rapidly with an increase in the number of parameters. More impor- 
tantly, the ratio of redundant to nonredundant tries also increases. Use of a variable 
step -size strategy (i.e., cut the step size after a number of failures in a row), which is 
employed in reference 4, may reduce the number of tries necessary when an overstep is 
encountered. However, this strategy can slow convergence significantly when a success 
could have been obtained in only a few of the many possible directions. Also, the suc- 
cessful use of this strategy is highly problem dependent, as will be demonstrated in the 
next section. 


PERFORMANCE ANALYSIS OF NONREDUNDANT ALGORITHM 

Two distinct groups of example problems {all two -parameter optimization problems 
with analytic solutions) were solved by using the nonredundant algorithm, with various 
combinations of the available strategies, in order to evaluate the performance of the 
method. The first group consisted of two. static problems (algebraic equations) and one 
dynamic problem {differential equations). The problems of this first group were used 
for strategy evaluation. The second group consisted of three nonlinear programing 
problems (inequality parameter constraints and a nonlinear cost function), two of which 
are static problems and the third is a dynamic problem. The problems of this second 
group were used to demonstrate the application of the algorithm to constrained problems. 

Strategy Evaluation 

The problems of the first group were used to evaluate the different strategy com- 
binations available, as well as any strategy parameters (i.e., the number of successes in 
a row to be required before increasing the step size under the variable step -size strat- 
egy). Conventional deterministic methods handle these problems readily. 

Before discussing the problems and results, however, some description of the 
strategies and their interaction should be presented. Table n lists the combinations of 
strategies used. The first strategy, pure random, is simply the basic algorithm. The 
second strategy, last successful direction first, is the basic algorithm with the restric- 
tion that the first direction tried immediately following a success is in the same direc- 
tion previously used. If use of this direction results in a failure, the remaining direc- 
tions are sampled in the standard manner. The third strategy, variable step size based 
on runs, has no influence on the directions selected but, rather, controls the step size of 
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the parameter perturbations and the reinitialization of the array of directions. Whenever 
a step -size change oceurs, the array is reinitialized. The fourth and fifth strategies, 
correlation on past history and on last success, respectively, operate essentially in the 
same manner as strategy 2 , except that several directions {the correlated directions) are 
tried before returning to standard sampling in the event of failures. The correlated 
directions include all directions that are less than ±90° away from the general direction 
of past improvements for strategy 4 and the last successful direction for strategy 5. 

Strategy combinations obey the following heirarchy now presented: 2, 4 or 5, 3. 

For example, strategy 11, consisting of the combined strategies 2, 3, and 4, would operate 
in the following manner after a success: 

(1) The first direction tried would be in the same direction as that in which the 
success was obtained. 

(2) If the first direction tried resulted in a failure, the next direction to be tried 
would be the direction in which past improvements were obtained (the trend direction). 

(3) If the second direction resulted in a failure, the remaining correlated directions 
would be tried. 

(4) If a success had still not been obtained, random sampling of the remainder of 
the directions would begin. 

(5) If at any point in the above procedure, the number of failures in a row exceeds 
the run parameter of strategy 3, the step size is cut, the array is reinitialized, and 
strategies 2 and 4 are discontinued until a success is obtained. 

Table III displays the rank each strategy achieved, the rank being based on the 
average number of iterations required for acceptable convergence for each of the fol- 
lowing problems (the average presented is based on 10 trails from the same point for 
each strategy, although averages were obtained from more than one starting point for 
dynamic problem I) : 

Static problem I (fig. 4): 

2 2 

min 

a l*“2 

which is subject to 

-ISc^S! (i-1, 2) 
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Dynamic problem I (fig. 6): 


min *l( Q! i) Q! 2) = j j(0*8 cos 3t - cos 10a +■ ||0.3 " 

which is subject to 

-1 £ a % Z 1 (i = 1, 2) 


li- 



-u_ 1 . i i 

-10 12 

a 2 

Figure 6.- Dynamic problem I. 

It should be mentioned that dynamic problem I was solved in a hybrid environment. The 
only difficulty arising in the hybrid implementation was one of resolution. Either rescal- 
ing the analog portion of the program in vastly differing regions of cost -function values 
is necessary, or some minimum resolution on the parameter values must be accepted and 
the minimum step size allowed for parameter perturbations must be limited. 

A review of table III demonstrates that strategy performance is problem dependent. 
However, strategy 2 (last successful direction first) and strategy 3 (variable step size 
based on runs) appear to be effective when used in combination with themselves and/or 
the other strategies. 

Table IV lists the results of the run -parameter studies for the two static problems. 
Again, the results (number of iterations to convergence based on averages from 10 trials) 
appear to be highly problem dependent, even in the two -parameter domain. This situa- 
tion would logically be intensified in a multiparameter domain. 

Due to the high degree of problem dependence exhibited by both the run parameters 
and strategy performance, another strategy that utilizes analyst -algorithm interaction to 
speed convergence will be introduced later in the present study. 
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Constrained Problems 


The problems of the second group were attempted in order to demonstrate the 
application of the algorithm to problems subject to inequality constraints. Before dis- 
cussing the problems, however, it is necessary to clarify the use of the term "inequality 
constraints." All three problems of the first group were subject to inequality constraints 
of the type shown in the equation 

(i= 1,2, . . „n) (1) 

Random -search methods handle this type of constraint without difficulty (steps across 
boundaries are simply not allowed), even in the region of a boundary where deterministic 
methods using a penalty -function approach have difficulty. For the purposes of this 
paper, a constraint in the form of equation (1) is referred to as an independent inequality 
parameter constraint; whereas a constraint in the form of the equation 

Fj^otj,o? 2 , • • ., ^j (1 = 2, . . m) (2) 


is referred to as a dependent inequality parameter constraint. The dependent constraint 
may be termed linear or nonlinear, depending on the functional form of Fj. 

The problems of the second group will now be discussed. Figure 7 displays the 
contour plot and the feasible region of solution for nonlinear static problem I as follows: 


min = fa^ - Q.5) 2 + (a 2 - 0.2^ 

a l’ a 2 


which is subject to 

-1 £ at £ 1 


a ^ + 2a 2 = 0.6 


(i = 1 , 2) (independent constraints) 
(linear dependent constraint) 


The creeping -search algorithm was implemented by using a penalty function for viola- 
tion of the dependent inequality constraint as follows: 

min J^aj,o! 2 ) = - Q.5) 2 + ( a 2 - 0.2) 2 + F p 

a l’ a 2 


where 


fi> a 1 

\?’ a l 


+ 2 “ 2 
+ 2<* 2 


> 0.6 

^ 0.6 


12 



I 



The algorithm converged, not to an extremal of the constrained problem, but rather to 
some point on the boundary formed by the dependent constraint; the reason for this 
behavior can be deduced from figure 8. Obviously, no matter what step size is used in 
the indicated convergence region of figure 8(a), steps in the eight possible directions will 
result in either constraint violations or larger cost -function values. However, if the 
boundary encounter had occurred outside of the region as shown in figure 8(b), conver- 
gence would be possible as long as the walk approached the optimal from below. 



Figure 8 . - Boundary convergence . 
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A simple adaptation of the algorithm that solves the above difficulty is to allow the 
algorithm two additional directions once a boundary is encountered; that is, one step in 
one direction along the dependent constraint, and the second step in the opposite direction 
along the constraint. This adaptation proved successful in solving this problem, as well 
as the following problems: 

Nonlinear static problem II (fig. 9): 


min 

a i’ a 2 



2a i - 2 q ?2 


which is subject to 
aij £ 0 

20^ + 6o 2 
+ 2^2 



(i = 1 , 2) (independent constraints) 
(linear dependent constraints) 



Figure 9-- Nonlinear static problem II. 


Nonlinear dynamic problem I (fig. 10): 


min 

a V a 2 


J ( a V a 2) 



COS 3t - Qg 


cos 


lOdfjty 



dt 


which is subject to 


-0.5 Sa 2 £ 11 
0 £ u 1 £ 0.4 


(independent constraints) 
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aig + 2a^ £ 1 


(nonlinear dependent constraint) 




-10 12 

(x 

2 

Figure 10.- Nonlinear dynamic problem I- 

Again, the dynamic problem was solved in a hybrid environment, with an additional 
resolution problem added by the necessity of being able to detect convergence to the 
boundary in order to allow the addition of the two directions along the boundary. Con- 
vergence to the boundary was possible only to within the neighborhood of the boundary 
dictated by the minimum step size allowed. Therefore, detection of a boundary encounter 
was considered accomplished when convergence to within the neighborhood took place. 

It should be noted that solutions to nonlinear static problems, with or without 
inequality constraints, are well documented in the literature (ref. 15). 

Applications 

Two investigations which have been made using the algorithm are a five -parameter 
human transfer function piloting an aircraft in a simple aircraft -pursuit problem (param- 
eter estimation) and a five -parameter beam -transport -design problem (parameter opti- 
mization). Before discussing these problems and some results, however, a description 
of the strategy utilizing analyst -algorithm interaction should be presented. 

The intended emphasis of the description is on the generation of the array of direc- 
tions and on the cathode -ray -tube (CRT) display capabilities. These two features are 
used jointly, hopefully to speed convergence, in the following manner; The analyst may, 
during algorithm operation, display on the CRT a history of the cost -function behavior 
versus number of iterations (both successes and failures), as well as histories of the 
value of each parameter versus number of successes (also available would be displays 
related to the model). Based on this information, the analyst may be able to determine 
the sensitivity of certain parameters in the current region of operation of the cost domain. 
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If a parameter appears sensitive, the gain, or perturbation size, of that parameter may 
be increased. On the other hand, if a parameter appears insensitive (varies randomly 
about some mean) or if the parameter requires a certain value in order to obtain a suc- 
cess, it may be made constant. In this situation, the number of possible directions is 
greatly reduced, as evidenced by table I, and the array of directions is regenerated for 
the reduced number of parameters involved. Use of this method to speed convergence 
is illustrated in figures 11 and 12. 

Figure 11 shows typical variations of parameters as a function of the number of 
successes from a seven -parameter study. The first parameter appeared to be 
quite sensitive in this region of the parameter space. Therefore, the analyst decided to 
increase the gain (the perturbation size) for this parameter. When the behavior of the 
parameter stabilized (became insensitive), it was made a constant. Little can be said 
of the sensitivity of a 2> although initially the analyst decided to increase its gain. The 
third parameter a 3 appeared to be insensitive in this region (note the difference in 



0 8 16 24 32 40 48 56 64 72 80 

Number of successes 

Figure 11 . - Typical parameter histories* 
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scales), whereas a ^ seemed to require a certain value to obtain successes with the 
present step size. Thus the analyst chooses to fix the values of some parameters and to 
increase or decrease gains on other parameters in order to speed convergence in the 
current region of the cost -function domain. 

The results of the analyst's decisions just discussed are displayed in figure 12 in 
terms of the cost function versus the total number of tries (both successes and failures). 
The analyst employed his initial decisions on the fifteenth success after 71 tries. As 
can be seen, successes occurred more often and with greater reductions in the cost func- 
tion. This method was used in the following two application problems. 



Figure Typical cost “function history^ 

Human -transfer -functio n problem . - As pointed out in reference 16, mathematical 
models for human pilots are beginning to play a large role in aerodynamic investigations. 
The present example is concerned with estimating the five parameters contained in a 
given transfer function used to pilot a simple three -degree -of -freedom aircraft model in 
a pursuit environment with a three -degree -of -freedom target (equations for this problem 
are presented in appendix A). The physical situation is represented in figure 13, and a 
block diagram of the system is illustrated in figure 14. Motivation for using the modi- 
fied creeping -random -search algorithm for this problem was the presence of limits on 
t ransf er -function variable s . 
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The parameters were to be estimated using a least -squares cost function consisting 
of differences between model response in the translational degrees of freedom and in 
normal acceleration a z and actual flight data available for these variables. However, 
in order to eliminate from consideration such things as measurement noise (on flight data) 



Figure 13. - Geometry of human transfer function problem. 

and process noise (modeling error) , as discussed in references 17 to 19 , pseudoflight 
data - or flight data obtained from the model itself for selected parameter values — 
were used for the purposes of this paper. Only the normal -acceleration data were used 
in the estimation process. 

Table V contains results obtained from the creeping-random -search algorithm, a 
steepest -descent algorithm, and a Davidon-conjugate-gradient algorithm for the same 
starting point, (The latter two algorithms used were part of the program of reference 7, 
and no attempt was made to alter the algorithms to handle the limits present in the math- 
ematical model,) Tabulated are the true parameter values, and for each algorithm, the 
starting values, the final values, the number of cost-function evaluations, and the total 
computer time (central -processing -unit usage). The results indicate that the presence 
of limits in the mathematical model degrade the gradient information required by both 
the steepest -descent algorithm and the Davidon-conjugate-gradient algorithm to such a 
degree that convergence to the proper parameter values are extremely time consuming, 
if indeed possible* 
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Figure 14.- Block diagram of hmian-transfer- function problem. 













Beam -t ransport -de s ign problem.- A beam -transport -design problem is concerned 
with transporting a high-energy beam of charged particles from one given area to another 
by utilizing magnetic fields. As reference 20 emphasizes, detailed computer -optimization 
solutions are highly desirable because of the large amount of effort and time that must be 
devoted to moving the unwieldy magnets. The fact that the problem inherently contains 
constraints on several state variables, as well as a stochastic model for representing 
individual members of the beam, often renders conventional deterministic optimization 
methods useless. 

From an a priori probability distribution, used to model the position of individual 
members of the beam prior to entering the magnetic field, a set of random initial condi- 
tions for the state variables is selected. The equations of motion are then solved to eval- 
uate the deviations from the desired end conditions and, also, to evaluate any violations 
of the state -variable constraints. This process is then repeated and the deviation is 
accumulated to form the mean cost function over the desired sample size. A constraint- 
violation percentage over the sample is also calculated and may be included in a weighted 
cost function if so desired. The parameters of the system, focusing strengths and sepa- 
ration distances of the magnets, are then perturbed by the creeping-search algorithm; 
and the entire sequence is iterated until convergence is achieved. A pooled t test, as 
described in reference 21, is used to determine successes or failures of parameter per- 
turbations, thus fixing a confidence level on differences in cost -function means. 

The five -parameter problem considered here used algebraic solutions, rather than 
numerical-integration solutions, of the linear differential equations of motion (nonlinear 
equations of motion are often required for other applications). The algebraic equations 
apply to the physical situation illustrated in figure 15, and all equations are presented in 
appendix B. A more complete treatment of the problem is found in reference 22. 

Again extensive use of the CRT display capabilities is made, not only for plots of 
the cost function versus number of iterations and time histories of parameter values for 
successful tries, but also for model displays such as output distributions along the trans- 
port path and beam traces through the focusing system. 

Figures 16 and 17 illustrate a typical starting point in the optimization process for 
one case under investigation. Figure 16 shows the output phase distribution at the end of 
the last magnetic field for the starting values of the parameters, as squares; the desired 
end condition is that the distribution lies within the ellipse. Figure 17 shows the beam 
traces for these starting values. Figures 18 and 19 show the same displays after the 
algorithm has achieved convergence. 
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Figure 15 -- Geometry of learn -transport problem. 






SIDE VIEW 


Figure 19 Beam traces for be am- transport problem. Cost function of 0*993 




CONCLUDING REMARKS 


A modified version of the creeping-random -search algorithm has been developed 
and applied to several different types of problems in the field of parameter identification. 
The modified version, the nonredundant algorithm, reduces the number of cost -function 
evaluations when compared to the unmodified version, the redundant algorithm. Also, it 
has been demonstrated that the algorithm can be applied successfully to problems that 
contain limits, inequality constraints (both dependent and independent, and linear and non- 
linear), and/or stochastic models; these are problems on which deterministic methods 
without modification are often of little value. 

Other results indicated that strategy performance within the algorithm is highly 
problem dependent and, therefore, difficult to implement successfully, A method that 
utilized analyst -algorithm interaction through a cathode -ray -tube display to speed con- 
vergence was shown to be feasible. 

Langley Research Center, 

National Aeronautics and Space Administration, 

Hampton, Va., November 12, 1971. 
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APPENDIX A 

EQUATIONS FOR HUMAN -TRANSFER -FUNCTION PROBLEM 

The equations for the human -transfer -function problem are presented in the fol- 
lowing two parts: (I) The transfer -function equations representing the human pilot, 
presented in Laplace notation, and (2) the equations of motion for two three -degree -of - 
freedom aircraft in a pursuit environment. 

The transfer -function equations are as follows: 



■*A = P A (s) 
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APPENDIX A - Concluded 

The equations of motion for the aircraft are as follows: 
Xrp = Vrji COS <^ T 

y T = V T sin 
x A = V A cos * A 
y A = V A sin 
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APPENDIX B 


EQUATIONS FOR BE AM -TRANSPORT -DESIGN PROBLEM 


The equations for the beam -transport -design problem are presented in the fol- 
lowing two parts: (1) The linear differential equations, which are not used in the digital 
program, and (2) the algebraic solutions to the differential equations, which are used in 
the program. The equations consist of translational equations which govern motion 
within a magnetic field and within a drift space, as well as extremum equations which 
determine extremes of the state variables within the magnetic fields in order to check 
for violation of the state -variable constraints. 

The differential equations within a magnetic field are 


and 



a i u 


0 



a^z 


0 


where i » 1, 2, 3, 4, 

The differential equations within a drift spaee are 


and 


dv 2 

dv^ 

The algebraic equations for magnetic field translation are as follows: 


u ( v out)~ u ( v in) cos jy|“i]( v out " v in)J 


sin, jlja^Vout - v ln )' 




= -»( v in)f S il s'flRvout - v in) 


du ( v in) _ 

+ i L COS 

dv 


^M( v out - vm) 
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APPENDIX B - Continued 


2 ( v out) = z ( v in) cosh LVN Nut - v in)J + 


dv L 


|( v out - v in)] 

\ 

(N 



dz 


^ - z ( v ln)^j“T[ *‘"h[jhT('W - v ln)] + cosh [|fhl ( Y out - v 


The algebraic equations for drift space translation are as follows: 

du/v in \ 

u ( v out) = u ( v in) + — 5“( T out ' v in) 


du ( v out) „ du ( v in) 
dv dv 


z ( v out) » z ( v in) + 


dv 


( v out - v in) 


dz ( Y out) _ dz ( Y in) 
dv dv 


The algebraic state -variable extremum equations within a magnetic field are as 
follows: 


r 

du ( v in) j 

1 tan' 1 

dv 

r , — tdll 

fl“iT u ( v ir^ 

)( v out - v in)> 



0<v< ( v out - v in) 
v ={ v out - v in) 


0 , 


v i 0 


u{v) = u(v in )cos \/K|v 



v 
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APPENDIX B - Concluded 



The algebraic equations are for positive focusing strength 04. For negative a i} 
the equations for u and z are simply interchanged; the u equations become hyper- 
bolic functionals, and the z equations become trigonometric functionals. 
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TABLE I.- COMPARISON OF NUMBER OF TRIES FOR BOTH 
ALGORITHMS BEFORE STEP -SIZE CUT 


Number of 
parameters, 
n 

Nonredundant 
tries, r 

(a) 

Redundant 
tries, r 
(P > 90 percent) 
(b) 

Redundant tries 

Nonredundant tries 

1 

2 

9 

4.50 

2 

8 

39 

4,88 

3 

26 

149 

5.73 

4 

80 

540 

6.75 

5 

242 

1 891 

7.81 

6 

728 

6 480 

8.90 

7 

2186 

21 850 j 

10.00 



TABLE H.- STRATEGY DEFINITIONS 


Pure random Strategy 1 

Last successful direction first Strategy 2 

Variable step size based on runs . . Strategy 3 

Correlation on past history . Strategy 4 

Correlation on last success Strategy 5 

Strategies 2 and 4 combined . Strategy 6 

Strategies 2 and 5 combined Strategy 7 

Strategies 2 and 3 combined Strategy 8 

Strategies 3 and 4 combined Strategy 9 

Strategies 3 and 5 combined Strategy 10 

Strategies 2,3, and 4 combined . Strategy 11 

Strategies 2,3, and 5 combined Strategy 12 
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TABLE III.- STRATEGY RANKINGS 


Strategy 

Static problem I 

Static problem II 

Dynamic problem I 

Rank 

Average number 
of iterations 
to convergence 

Rank 

Average number 
of iterations 
to convergence 

Rank 

Average number 
of iterations 
to convergence 

8 

2 

44 

2 

58 

1 

33 

12 

1 

35 

1 

45 

6 

59 

11 

4 

56 

3 

60 

3 

48 

10 

3 

51 

4 

64 

5 

54 

9 

10 

175 

5 

70 

2 

38 

3 

5 

66 

10 

269 

1 3 

48 

7 

8 

143 

7 

153 

; 7 

156 

6 

6 

97 

8 

168 

8 

161 

2 

9 

156 

6 

132 

9 

169 

5 

7 

118 

9 

200 

11 

247 

1 

11 

198 

12 

307 

10 

233 

4 

12 

298 

11 

280 

12 

423 
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TABLE IV.- RUN PARAMETERS 

[S = Number of successes in a row before step increase; 
F = Number of failures in a row before step decrease] 



Average number of iterations to convergence when — 

F 

S = 1 

3 = 2 

S = 3 

S * 4 

S = 5 

S = 6 



Static problem I 



1 

1X3.6 

88.7 

68.7 

68.1 

49.7 

63.8 

2 

80.9 

83.2 

138 

128.8 

175.6 

181.7 

3 

84.3 

71.8 

79.9 

75.3 

87.6 

80.7 

4 

104.3 

77.7 

80.0 

82.2 

79.9 

78.8 

5 

122.3 

88.2 

94.9 

89.0 

87.2 

86.3 

6 

112.7 

99.1 

100.9 

96.8 

93.4 

93.9 



Static problem II 



1 

772.6 

326.5 

184.5 

146.0 

145.7 

130.3 

2 

166.0 

1694.6 

1878.6 

803.8 

763.0 

659.9 

3 

93.3 

265.9 

1438.1 

4930,4 

4700.1 

2720.2 

4 

99.1 

258.6 

264.7 

829.9 

1112.2 

1853.9 

5 

118.7 

232.2 

235.5 

302.2 

398.1 

795.3 

6 

121.5 

255.3 

249.8 

269.9 

248.4 

410.0 
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TABLE V.- COMPARISON OF ALGORITHMS FOR 
HUMAN -TRANSFER -FUNCTION PROBLEMS 



True 

value 

Creeping search 

Steepest descent 

Davidon 

Parameters 

Starting 

value 

Final 

value 

Starting 

value 

Final 

value 

Starting 

value 

Final 

value 

°T 

14.75 

13.00 

14.75 

18.00 

15.483 

18,00 

16.443 

a 2 

10.0 

13.00 

10.0 ! 

13.00 

12.235 

13.00 

13.147 

«3 

26.5 

30.00 

26.5 

30.00 

29.112 

30.00 

29.950 

^4 

25.4 

20.00 

25.4 

20.00 

27.497 

20.00 

19.995 


.1 

.17 

.1 

.17 

.09678 

.17 

.09847 

Cost 

No* cost “function 

“ 

0.65814 

” 0 

’ 0.65814 

0.001736 

0.65814 

0.00603 

evaluations * * , 
Total computer 



2723 


3652 


4384 

time 



1743 


1828 

1 

2210 


NASA-Umgtey, 3371 8 Xj-7853 
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